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Abstract — We present a construction of LDPC codes that have 
minimum pseudocodeword weight equal to the minimum dis- 
tance, and perform well with iterative decoding. The construction 
involves enumerating a d-regular tree for a fixed number of 
layers and employing a connection algorithm based on mutually 
orthogonal Latin squares to close the tree. Methods are presented 
for degrees d = p s and d = p s + 1, for p a prime, - one of which 
includes the well-known flnite-geometry-based LDPC codes. 

I. Introduction 

Low Density Parity Check (LDPC) codes are widely ac- 
knowledged to be good codes due to their near Shannon- 
limit performance when decoded iteratively. However, many 
structure-based constructions of LDPC codes fail to achieve 
this level of performance, and are often outperformed by ran- 
dom constructions. (Exceptions include the finite-geometry- 
based LDPC codes (FG-LDPC) of [1], which were later 
generalized in [2].) Moreover, there are discrepancies between 
iterative and maximum likelihood (ML) decoding performance 
of short to moderate blocklength LDPC codes. This behavior 
has recently been attributed to the presence of so-called 
pseudocodewords of the LDPC constraint graphs, which are 
valid solutions of the iterative decoder which may or may not 
be optimal [3]. Analogous to the role of minimum Hamming 
distance, d m i n , in ML-decoding, the minimal pseudocodeword 
weight, u> m i n , has been shown to be a leading predictor of 
performance in iterative decoding. Furthermore, the error floor 
performance of iterative decoding is dominated by minimal 
weight pseudocodewords. Although there exist pseudocode- 
words with weight larger than d m [ n that have adverse affects 
on decoding, pseudocodewords with weight u> m i n < d m - ln are 
especially problematic [4]. 

The Type I-A construction and certain cases of the Type II 
construction presented in this paper are designed so that the 
resulting codes have minimal pseudocodeword weight equal 
to the minimum distance of the code, and consequently, these 
problematic low-weight pseudocodewords are avoided. The 
resulting codes have minimum distance which meets the lower 
tree bound originally presented in [5], and since ui m i n shares 
the same lower bound [4], [6], and is upper bounded by <i m i n , 
the proposed constructions have w m i u — d m i u . It is worth 
noting that this property is also a characteristic of some of the 
FG -LDPC codes [2], and indeed, the projective-geometry- 
based codes of [1] arise as special cases of our Type II 
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construction. Furthermore, the Type I-B construction presented 
herein is a modification of the Type I-A construction, and 
it yields a family of codes with a wide range of rates and 
blocklengths that are comparable to those obtained from finite 
geometries. 

We now present the tree bound on u) m j n derived in [6]. 

Theorem 1.1: Let G be a bipartite LDPC constraint graph 
with smallest left (variable node) degree d and girth g. Then 
the minimal pseudocodeword weight u> m i n (for the AWGN/BSC 
channels) is lower bounded by 

^ J 1 + d + d(d - 1) + d(d - l) 2 + . . . + d(d - 1)^, § odd 
Wmin rr_ S g-8 g-4 

^ 1 + d + d(d - 1) + . . . + d(d - l)^ - + (d - , § even 

This bound is also the tree bound on the minimum distance 
established by Tanner in [5]. And since the set of pseudocode- 
words includes all codewords, we have w m [ n < d m [ n . In the 
following sections we present two construction techniques of 
LDPC codes wherein for certain cases, w m in = rfmin- 

II. PRELIMINARIES 

The connection algorithms for the tree constructions Type 
I-B and Type II are based on mutually orthogonal Latin 
squares. A well-known construction of a family of mutually 
orthogonal Latin squares of order p s , a power of a prime, 
may be found in [7]. Let . . . , M^" 1 ) denote 

p s — 1 mutually orthogonal Latin squares (MOLS) of order 
p s . Let the rows (and columns) of each square be indexed 
by the integers 0,1,2, ... ,p s — 1. Without loss of generality, 
assume that the first column of each of the Latin squares 
is [0, 1, 2, . . . ,p s — 1] T . In addition, define a new square of 
size p s x p s , denoted M^°\ where each column of is 
[0,l,2,...,p s -l] T . 

III. Tree-based Construction: Type I 

In the Type I construction, first a d-regular tree of alternating 
variable and constraint node layers is enumerated from a root 
variable node (layer Lq) for £ layers. If I is odd (respectively, 
even), the final layer L^_i is composed of variable nodes 
(respectively, constraint nodes). Call this tree T. The tree T 
is then reflected across an imaginary horizontal axis to yield 
another tree, T', and the variable and constraint nodes are 
reversed. That is, if layer Li in T is composed of variable 
nodes, then the reflection of Li, call it L\, is composed of 
constraint nodes in the reflected tree, T". The union of these 
two trees, along with edges connecting the nodes in layers 
and L' e _ 1 according to a connection algorithm that is 



described next, comprise the graph representing a Type I 
LDPC code. We now present two connection schemes that 
can be used in this Type I model, and discuss the resulting 
codes. 

A. Type I-A 

For d = 3, the Type I-A construction yields a d-regular 
LDPC constraint graph having 1 + d + d(d — 1) + . . . + 
d(d — variable and constraint nodes, and girth g. The 

tree T has | layers. To connect the nodes in Ls._ x to L'g__ v 
first label the variable (resp., constraint) nodes in £|_i 
(resp., L' g _ x ) when | is odd, as Vq,Vi, . . . ,v s_ 2 , 
v s , v s, , v s v s, (resp., 

23 _ 21 ' 2-23~ 2 -l' 2-23 -2 ' ' 3-23~ 2 -l v F ' 

co,ci,.. .,c 32 9_ 2 1 ). The nodes «o, «i, • • • ,w 2 f -2_ 1 
form the th class, the nodes u «_,,..., t> s _ 2 form the 

23 2 ' ' 2-23 -1 

I s * class, and the nodes u s v a „ form the 

2-23 2 ' ' 3-23 2 -l 

2 nd class; classify the constraint nodes in a similar manner. 
In addition, define three permutations it(-),t(-),t' (■) of the 
set {0, 1, . . • , 2^~ 2 — 1} as follows. The nodes in Lb_ 1 and 
L'g . are connected as follows: 

2 1 

1) For i = 0, 1, and j = 0, 1, ... , 2^ ~ 2 — 1, the variable 
node u s_ 2 is connected to nodes c , „ s_ 2 and 

j+i-23 2 7r(j)+i-23 
C r(j) + (i+l)-23- 2 - 

2) For i = 2, and j = 0, 1, . . . , 2a ~ 2 — 1, the variable node 
v s 2 is connected to nodes c s , and c T ;/,-v 

j+i-22 2 ir(j)+2-2 2" 2 T U; 

The permutations for the cases g = 6, 8, 10, 12 are given 
below. The above construction can be extended for higher g in 
a natural way and we are working on an explicit closed form 
expression for the permutations it, r, r' for higher g. 

g — 6,7r — r — t = (0)(1), the identity permutation. 
g = 8,rr = (0)(2)(1,3),t = (0)(2)(1,3),t = (0,2)(1)(3). 
g = 10, = (0)(2)(4)(6)(1, 5) (3, 7), r = (0)(2)(4)(6)(1, 7) (3, 5), 

r' = (0,4)(2,6)(1,3)(5,7). 
g = 12, OT = (0) (4) (8) (12) (2, 6) (10, 14)(1,9)(3, 15)(5, 13)(7, 11). 
r = (0)(4, 12)(8)(2, 6. 10, 14)(1, 15, 13, 11)(3, 9, 7, 5), 
t' = (0, 8) (4, 12)(2, 14)(6, 10)(1, 3, 5, 7)(9, 11, 13, 15). 

When | is odd, the minimum distance of the resulting code 
meets the tree bound, and hence, d m [ n = w m i n . When | is 
even, <i m j n is strictly larger than the tree bound; we believe 
however, that w m - m is equal to d m [ n in this case as well. 
Figure illustrates the general construction procedure and 
Figure 13 shows a girth 10 Type I-A LDPC constraint graph. 

B. Type I-B 

For d = p s ,p a prime, the Type I-B construction yields 
a d-regular LDPC constraint graph having 1 + d + d(d — 
1) variable and constraint nodes, and girth 6. The tree T 
has 3 layers Lq,Li, and L^. L2 (resp., L' 2 ) is composed 
of p s sets {Sij^Q 1 of p s — 1 variable (resp., constraint) 
nodes in each set; the set 5, corresponds to the children 
of branch i of the root node. Let Si (resp., S£) contain 
the variable (resp., constraint) nodes v^i, Uj 2> • • • > i>i,p a -i 




Fig. 1. Tree construction of Type I-A LDPC code. 




Fig. 2. Type I-A LDPC constraint graph having degree d = 3 and girth 
9 = 10. 

(resp., Ci t i, Ci ; 2, ■ ■ ■ , Ci tP s_i). To use MOLS of order p s in 
the connection algorithm, an imaginary node, v i (resp., Cj 0) 
is temporarily introduced into each set Si (resp, S^). The 
connection algorithm proceeds as follows: 

1) Let x t (i,j) denote the (j,t) th entry of the square 
defined in Section II. For i = 0, . . . ,p s — 1 and j = 
0, . . . ,p s — 1, connect variable node Vij to constraint 
nodes CQ,x {i,j)i c i,xx{i,j)i • ■ • 1 V-i^-ifij)' 

2) Delete all imaginary nodes {u^o, (k,o}i=o anc ^ tne e dges 
incident on them. 

3) For i = 1, . . . ,p s — 1, delete the edge connecting v o i 
to C ,.£. 

The resulting d-regular constraint graph represents the Type I- 
B LDPC code. Figure [3] illustrates the construction procedure 
and Figure @] provides a specific example of a Type I-B LDPC 
constraint graph with d = 4; the squares used for constructing 
this graph are 

"0000"| ["01231 ["02311 [0312 
1111 1032 1320 1203 

2222 1 2301 5 2013 7 2130 
3333J |_321oJ [_3102j [3021 

The Type I-B algorithm yields LDPC codes having a wide 
range of rates and blocklengths that are comparable to, but 
different from, the two-dimensional LDPC codes from finite 
Euclidean geometries [1], [2]. The Type I-B LDPC codes 
are p s -regular with girth six, blocklength N = p 2s + 1, and 
distance d m i n > p s + 1. For degrees of the form d = 2 s , the 
resulting Type I-B codes have very good rates, above 0.5, and 
perform well with iterative decoding. 

IV. Tree-based Construction: Type II 

In the Type II construction, first a d-regular tree T of 
alternating variable and constraint node layers is enumerated 




Fig. 3. Tree construction of Type I-B LDPC code. (Shaded nodes are 
imaginary nodes and dotted lines are imaginary lines.) 




Fig. 4. Type I-B LDPC constraint graph having degree d = 4 and girth 
3 = 6. 



from a root variable node (layer L ) for £ layers, as in Type I. 
The tree T is not reflected; rather, a single layer of (d— 
nodes is added to form layer Lg. If I is odd (resp., even), this 
layer is composed of constraint (resp., variable) nodes. The 
union of T and Lg, along with edges connecting the nodes in 
layers Lg^i and Lg according to a connection algorithm that 
is described next, comprise the graph representing a Type II 
LDPC code. We now present the connection scheme that is 
used for this Type II model, and discuss the resulting codes. 
The connection algorithm for I = 3 and I — 4 proceeds as 
follows. 

A. £ = 3 

The d constraint nodes in L\ are labeled Bo,B\, . . . , B p s 
to represent the d branches stemming from the root 
node, and the d(d — 1) variable nodes in the third 
layer L2 are labeled as -Bq.o, -Bo,i' ■ ■ ■ > Bo, p *-i, 



Bifi, . . • , B\ 



B 



p s ,0, 



,B 



The 



P 



constraint nodes in the final layer Lg 

A),o, ^4.0,1) * * • j A),p s -i! ^4.1,0) 



= L-3 are labeled 
• ■ j Ai iP s-i, . . ., 



.4 



p s -l,0 

1) The constraint nodes in L3 are grouped into d — 1 = p s 
classes of d — 1 = p s nodes in each class. Similarly, 
the variable nodes in L2 are grouped into d = p s + 
1 classes of d — 1 = p s nodes in each class. Those 
nodes descending from Bo form the th class, those 
descending from B\ form the first class, and so on. 

2) Each of the variable nodes descending from Bo is 
connected to all the constraint nodes of one class. 



That is, Bo.o is connected to Ao.o, A),i> ■ ■ ■ > ^o,p s -i> 
Bq i is connected to A\$, -4.1,1, • • • , A-x,p s -x, and in 
general, B ,k is connected to A kfi ,A ktl ,...,A ktV s_ 1 
which correspond to the constraint nodes in the k th 
class. 

3) Let x t (i,j) denote the {j,t) th entry of M (l_1) . 

4) Then connect the variable node Bi , to the constraint 



nodes 



1 A r 



Figure |3 illustrates the construction procedure and Figure [6] 
provides an example of a Type II LDPC constraint graph with 
degree d = 4 and girth g = 6; the squares used for constructing 
this example are 



M^ 1 



The ratio of minimum distance to blocklength of the codes 
is at least yq^irp^s?, and the girth is six. For degrees d of 
the form d = 2 s + 1, the tree bound on minimum distance 
and minimum pseudocodeword weight [5], [6] is met, i.e., 
dm'm = w m i n = 2 + 2 s , for the Type II, £ = 3, LDPC codes. 

B. Relation to finite geometry codes 

The codes that result from this I — 3 construction 
correspond to the two-dimensional projective-geometry-based 
LDPC (PG LDPC) codes of [2], With a little modification 
of the Type II construction, we can also obtain the two- 
dimensional Euclidean-geometry-based LDPC codes of [2]. 

Since a two-dimensional Euclidean geometry may be ob- 
tained by deleting certain points and line(s) of a two- 
dimensional projective geometry, the graph of a two- 
dimensional EG-LDPC code [2] may be obtained by perform- 
ing the following operations on the Type II, I = 3, graph: 

1) In the tree T, the root node along with its neighbors, 
i.e., the constraint nodes in layer L\, are deleted. 

2) Consequently, the edges from the constraint nodes 
Bo, ■ ■ ■ , Bps to layer L2 are also deleted. 

3) At this stage, the remaining variable nodes have degree 
p s , and the remaining constraint nodes have degree 
p s + 1. Now, a constraint node from layer L3 is chosen, 
say, constraint node Ao.o- This node and its neighboring 
variable nodes and the edges incident on them are 
deleted. Doing so removes exactly one variable node 
from each class of L2, and the degrees of the remaining 
constraint nodes in L3 are lessened by one. Thus, the 
resulting graph is now p s -regular with a girth of six, has 
p 2s — 1 constraint and variable nodes , and corresponds to 
the two-dimensional Euclidean-geometry-based LDPC 
code EG{2 lP s ) of [2]. 

C. £ = 4 

1) The tree T is now enumerated for four layers, 
with the nodes in Lo,Li, and L2 labeled as 
in the £ = 3 case. For i = Q,...,p s , the 
constraint nodes in the zth class of L% are labeled 

Bi,o,o, Bi t o,i, ■ ■ ■ , Bi : o, p s~i, Bi,i t o, ■ ■ ■ , Bi i i tP s_i, 

• • -7 Bi ps —1.0 ; ■ ■ ■ 1 Bi ps _1ps_l . 



LI 




Fig. 5. Tree construction of girth 6 Type II (£ = 3) LDPC code. 




A 0,0 A D,l A tU *U*IJ*U A 2,G A 2,I A 2J 



Fig. 6. Type II LDPC constraint graph having degree d = 4 and girth g = 6. 
(Shaded nodes highlight a minimum weight codeword.) 

2) The p 3s variable nodes in the final layer L4 are labeled 

A), 0,0, Aj,o,i> • • • 1 A),o,p s -i7 A),i,0i ■ ■ ■ i A),i,p s - 

. . . , Aps —i : p s —l.o j Aps —i : p s — 1,1 , . ■ ■ , Aps —i ^s_i ps _i, 

3) For < i < p s — 1, < j < p s — 1, connect the 
variable node Bq^j, that is in the 0*' 1 class of L3, to 
the constraint nodes Aijp, Aj^i, . . . , Ai t j iP a_x. 

4) Let x t (i,k) = M^-^(k,i)', the (k,'t) th entry of 
M^" 1 ), and let y t (i,j) = M^(j,t), the (j,t) th entry 
of M^ l *\ where i* = i mod p s . 

5) Then, for 1 < i < p s , < j, k < p s — 1, connect the 
variable node Bij t k t0 the constraint nodes 

-0,xo(i,fc),Bo(j,fc)) ,1/1 • • • j J 4p s -l,a; p s_ 1 (i,fc),j/ p s„ 1 (j,fc)- 

The Type II, £ = 4, LDPC codes have girth eight, minimum 
distance d min > 2(p s + l), and blocklength N = l+p s +p 2s + 
p 3s . (We believe that the tree bound on the minimum distance 
is actually met for all the Type II, £ = 4, codes, i.e. d m i n = 
w m in = 2(p s + l).) FigureQillustrates the general construction 
procedure. For d = 3, the Type II, £ = 4, LDPC constraint 
graph as shown in Figure [8] corresponds to the (2, 2)-Finite- 
Generalized-Quadrangles^ased LDPC (FGQ LDPC) code of 
[8]; the squares used for constructing this code are 

m<°> = [ ; ; ] , m« = [ ; j ] . 

We believe that the Type II, £ ~ 4, construction results in 
other FGQ LDPC codes for other choices of d. The Type 
II construction algorithm can be modified for larger £ by 
involving more iterations of the MOLS in the connection 
scheme, as will be discussed in a forthcoming paper. 




Fig. 7. Tree construction of girth 8 Type II (£ = 4) LDPC code. 




Fig. 8. Type II LDPC constraint graph having degree d = 3 and girth 9 = 8. 
(Shaded nodes highlight a minimum weight codeword.) 



V. Simulation Results 

Figures l9l II 01 II II [l2l show the bit-error-rate performance of 
Type I- A, Type I-B, Type II girth six, and Type II girth eight 
LDPC codes, respectively over a binary input additive white 
Gaussian noise channel with min-sum iterative decoding. The 
performance of regular or semi-regular randomly constructed 
LDPC codes of comparable rates and blocklengths are also 
shown. (All of the random LDPC codes compared in this paper 
have a variable node degree of three and are constructed from 
the online LDPC software available at 

|http : / / www . cs . toronto . edu/| radf ord/ldpc . software . html.) 

Figure [9] shows that the Type I-A LDPC codes perform 
substantially better than their random counterparts. Figure ^3 
reveals that the Type I-B LDPC codes perform better than 
comparable random LDPC codes at short blocklengths; but as 
the blocklengths increase, the random LDPC codes tend to 
perform better in the waterfall region. Eventually however, as 
the SNR increases, the Type I-B LDPC codes outperform the 
random ones since, unlike the random codes, they do not have 
a prominent error floor. Figure [^ revea l s that the performance 
of Type II girth-six LDPC codes is also significantly better 
than comparable random codes; these codes correspond to 
the two dimensional PG LDPC codes of [2]. Figure ^] 
indicates the performance of Type II girth-eight LDPC codes; 
these codes perform comparably to random codes at short 
blocklengths, but at large blocklengths, the random codes 
perform better as they have larger relative minimum distances 
compared to the Type II girth-eight LDPC codes. 

As a general observation, min-sum iterative decoding of 



Performance o( Type I versus Random LDPCs 




* Type I. d 3.g 6.N lO.rale 0.400 
-» Random. N 10.raie-0 400 

Type I. d=3.g=8.N^22.raie=0.182 
-0 Random. N 22.rate=0 182 
o Typel.d 3,g- ION 46.raie 0217 
-O Random. N 46.rate=0 217 
-a- Typel.d 3.g- i2.N-94,rate^ 148 
-a ■ Random, N=94,rale=0.148 



Performance of Type l-B versus Random LDPCs 



" Type l-B. d-3.g-6.N-10.M 
* Random. N-10.ratc-0 300 
Type l-B. d-4.g-6.N-17.ra 
Random. N-17.taic-0 294 
-b- Type l-B. d-5.g-6.N-26.ra 
l Random. N-26.ratC-0 269 

> Type l-B. d-8.g-6.N-65.ra 

> Random. N-65.ratC=0 477 
-»- lype l-B. d-16.g-6.N-257.iate-0 626 
-• Random. N-257. 

o Type i-B. d-32.g-6.N-i025.'ate-0V32 
o Random. N-1025.ratc-0 732 



-0 300 
-0 294 



.1 2f,<i 



-0 477 




Fig. 9. Performance of Type I-A versus Random LDPC codes with min-sum 
iterative decoding. 



Fig. 10. Performance of Type I-B versus Random LDPC codes with min-sum 
iterative decoding. 



most of the tree-based LDPC codes (particularly, Type I-A, 
Type II, and some Type I-B) presented here did not typically 
reveal detected errors, i.e., errors caused due to the decoder 
failing to converge to any valid codeword within the maximum 
specified number of iterations. Detected errors are caused 
primarily due to the presence of pseudocodewords, especially 
those of minimal weight. We think that the lack of detected 
errors with iterative decoding of these LDPC codes is primarily 
due to their good minimum pseudocodeword weight w m [ n . 

VI. Conclusions 

The Type I construction yields a family of LDPC codes 
that, to the best of our knowledge, do not correspond to 
any of the LDPC codes obtained from finite geometries or 
other geometrical objects. The two tree-based constructions 
presented in this paper yield a wide range of codes that 
perform well when decoded iteratively, largely due to the 
maximized minimal pseudocodeword weight. However, the 
overall minimum distance of the code is relatively small. 
Constructing codes with larger minimum distance, while still 
maintaining d m { n = w m i nv remains an open problem. 
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Performance of Type II versus Random LDPCs (Girth = 6) 




-*- Type II. d 3.N 7.rale 42 

-« Random. N 7.rale 0.42 

-$- Type ll. d 5.N 21. rale 52 

-0 Ranaom. N 21.rale 0.52 

-e- Type ll. d 9.N 73.rale 61 

o Random, N 73.rate 61 

ii Type ll. d 17.N 273.ra:e 069 

u Random. N 273.tale 0.69 

-«<- Type ll. d 33.N I05?.ra!e 0.77 

-«■ Rat'dom. N 1057.rate 0.77 



Fig. 11. Performance of girth 6 Type II versus Random LDPC codes with 
min-sum iterative decoding. 



Performance of Type II versus Random LDPCs (Girth = 8) 



* Type II. £J 3.N IS.raie 333 
-* Random. N- l5.raie-0.333 

■0 Type ll. d 5.N 85.rate 412 
-0 Random. N=85.rate=0.4l2 
-6- Type ll. d 9.N 585.rate 0.444 

Random. N=585.rate=0 444 
-e- Type ll. d^4.N=40.rate=0 325 

1 Random. N 40 raie 325 




Fig. 12. Performance of girth 8 Type II versus Random LDPC codes with 
min-sum iterative decoding. 



